Gesture Recognition of the Upper Limbs - From Signal to Symbol
نویسندگان
چکیده
To recognise gestures performed by people without disabilities during verbal communication – so-called coverbal gestures – a flexible system with task-oriented design is proposed. The issue of flexibility is addressed via different kinds of modules – grasped as agents –, which are grouped in different levels. They can be easily reconfigured or rewritten to suit another application. This system of layered agents uses an abstract body-model to transform the up-taken data from the sixdegree-of-freedom-sensors, and the data gloves, to a first-level symbolic description of gesture features. In a first integration step the first-level symbols are integrated to second-level symbols describing a whole gesture. Second-level symbolic gesture descriptions are the entities which can be integrated with speech tokens to form multi-modal utterances.
منابع مشابه
Hand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملRepresentation of Human Postures for Vision-Based Gesture Recognition in Real-Time
In this paper, we present a Vision-Based Interface guided by the user gestures. The advantage of our system is that it is built over a motion capture system that recovers the body joints positions of the user’s upper body in real-time. From the computed joints positions we make this data spatially invariant by normalizing limbs positions and sizes, only using the limbs orientations. From limbs ...
متن کاملAn Efficient Application of Gesture Recognition from a 2D Camera for Rehabilitation of Patients with Impaired Dexterity
An efficient method for utilising a 2D camera to recognise hand gestures in 3D space is described. The work is presented within the context of a recuperation aid for younger children with impaired movement of the upper limbs on a standard Android tablet device. The hand movement recognition is achieved through attaching brightly coloured models to the child’s fingers, providing easily trackable...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کامل